First thing is 604's don't handle lots of power so cranking them way up is not a good thing.
Second thing the different loads on your amp isn't good either.